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ABSraftCT 

Methods of regression (xnmonality analysis are gener2LLized for use in canonical 
correlation analysis. An actual data set is enployed to illustrate the extension^ The 
inethod can be applied with respect to each canonical function in an analysis to 
determine the proportion of explanatory power of a variable or variable set which is 
unique and the proportion which is shared with or conitDn to other variables also. 
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Canonical cx)i: relation analysis (Hotelling, 1935) has been available to researchers 
in theory for some 50 years. Ker linger (1973, p. 652) suggests that "some research 
problens alnost demand canonical analysis" and Cooley and Lohnes (1971, p. 176) argue 
that "it is the sinplest model that can begin to do justice to this difficult problem 
of scientific generalization." Krus, Reynolds . and Krus (1976, p. 725) noted that, 
"Dormant for nearly half a century, Hotelling^s (1935, 1936) canonical variate analysis 
has oofoe of age. The principal reason behind its resurrecticxi was its oonputerization 
and inclusion in major statistical packages." 

Notwithstanding Levine^s (1977, p. 8) assertion that "especially with respect to 
canonical correlation, there seem to be relatively few remaining puzzles to be solved," 
several puzzles involving the technique have been recognized and resolved in recent 
years. Noteworthy exanples include specialized canonical rotation procedures (Bentler 
& Huba, 1982) , backward variable elimination procedures (Thotpson, 1982b) , and 
procedures to estimate result invar iance (Thonpson, 1982a). Thompson (1984a) 
summarizes these and other recent extensions of canonical methods. 

The present paper discusses methods of partitioning the ability of the variables 
in a cancwiical set to explain the variables in the other canonical set. These methods 
were originally developed for application in multiple regression analysis and have come 
to be referred to as "comonality analysis" (Pedhazur, 1982, pp. 199-211). Cooley and 
Lohnes (1976, p. 219) suggest that "the comonality mettHDd of partitioning of variance 
in multivariate regression is an informative, conservatively safe method for most 
situations." Lohnes and Cooley (1978, p. 17) argue that the results of ooimonality 
analyses "can well be the frosting on the cake that get the first attention." Bie fact 
that "virtually all of the comonly encountered parametric tests of significance can be 
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treated as special cases of canonical correlation analysis" (Knapp, 1978 , p* 410) 
suggests that oomonality analysis might cdso be applied usefully in the canonical 
case, if a cancHiical extensicwi of this regression method can be specified* Data from 
an actual study will be used to illustrate the applicaticxis of this extension* 

Commonality Analysis 

Camonality analysis was originally developed for use in regression studies under 
the rubrics, "elonent analysis" (Newton & Spurrell, 1967) and "corponents analysis" 
(Mayeske, Wisler, Beatoi, Weinfield, Cohen, Okada, Proshek & Tabler, 1969). The 
analysis indicates how much of the explanatory power of a variable is "unique" to the 
variable, and how much of the variable'^s explanatory ability is "comton" to or also 
available from one or more other variables* Mxd (1969) presents an algebraic rule for 
computing these variance partitions for any number of variables* In addition to 
tabling the coqputaticnal procedures for studies involving up to five variables in a 
set, Seibold and McPhee (1979) provide a brief and understandable introduction to this 
method as applied in the regression case* 

Two features of cannonality analysis merit some explanation* First, oomiCTialities 
should not be confused with the interacticxi effects investigated in PUKNk studies 
(Seibold & McPhee, 1979, p* 365)* As ThonpsOTi (1984b, p* 8) explains, "interacticm is 
the unique effect of two or more independent variables which in combination affect the 
dependent variable* Commonality indicates the proportion of predictive ability of a 
single variable that also happens to reside in another single predictor variable too; 
no unique effect of the predictors acting in combination is involved*" 
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Secx)od, although uniqueness estimtes can never be negative, cximcnality 
partitions can be. This is counterintuitive since the result seems to indicate that 
two or more variables have in oontnon the ability to explain less than zero percent of 
the variance in the criterion variable or variable set. Instead, negative 
ccnmiHialities frequently indicate the presence of suppressor effects (DeVito, 1976, 
p. 12). BeatCHi (1973, p. 12) provides a conceptual illustration of how a negative 
comonality can have in?)ortant substantive iitplications: 

Both weight and speed are inportant to success as a 
t^ofessional football player and each would be noderately 
correlated with a measure of success in football. Weight and 
speed are presumably negatively correlated and would have a 
negative conmOTality in predicting success in football. If 
both weight and speed are known, one would expect to make a 
much better prediction of success using both variables to 
select fast, heavy men rather than just selecting tlie fastest 
regardless of speed. Thus the negative oonmcxiality indicates 
that explanatory power of either is greater when the other is 
used. 

Beaton^s conceptual exanple is supplemented by Seibold and McPhee'^s (1979, pp. 364-365) 
report of regress iai results from an actual cancer study that may well have been 
grossly misinterpreted if a ocimonality aneilysis detecting suppressor effects had not 
been conducted. 

Example Canonical Extension 
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As noted previously, oonronality analysis has not been applied to partition the 
squared canonical correlation coefficient, although coprmxiality analysis has been 
applied to partition both squared multiple correlation and redundemcy coefficients 
(Oooley & Lohnes, 1976). The extension proposed here capitalizes on the fact that 
canonical analysis can be performed using a regression ocn|xiter routine if one set of 
variables is aggregated into canonical variate scores. Then the previously discussed 
rules for variance partitioning can also be applied in the multivariate case. An 
example application illustrates the procedure. 

Miller (1984) reports a study of the death anxiety of various grocps of educators 
who differ in their degree of contact with terminally ill youngsters. The theoretical 
framework and additional details of the study are presented in the original report, 
although a ooirmonality analysis was not conducted by Miller. The tabled results are 
reported here in sane detail for readers who wish to verify selected results. 

INSERT TRHLE 1 ABOUT HERE. 

The first step in canonical comiKXialit^ analysis involves the calculation in the 
usual manner of canonical functions and canonical correlation coefficient-^. These 
analyses are based on the correlation matrix presented in Table 1 and involved four 
criterion variables to "Z") and six predictor variables ("A" to "F") . The first 

canonical function is also presented in Table 1. The same procedures can be applied to 
partition the squared canonical correlation for any function, so discussic«i of only the 
first function should suffice as an example. The squared canonical correlation 
associated with the first function was .13739 (Rc = .37066, chi squcired = 38.71, df - 
24, 2 < -05). 
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The second step in canonical coramonadity analysis involves the calculation of 
canonical variate scores for all subjects. In the present exanple the partition was 
conducted to explore the ability of the six predictors to explain variance in the 
criterion variable set, so variate scores were contxited for all 160 subjects using the 
function coefficients presented in Table 1. The function coefficients are maltiplied 
tijnes subjects'* Z-scores on the critericwi variables. For example, for the first 
subject the oonputations were: 

(.56672 X ZOOPING) + (.63526 x ZFEAR) -f (-.49114 x ZSBOia?) + (.18460 K ZPAINFUL) 
(.56672 X .11606) + (.63526 x -.17941) -f (-.49114 x -.31146) + (.18460 x 1.00038) 

.06583 - .11397 + .15297 + .18467 = .28950 
Of course, sane statistics packages readily ooinpute variate scores as an option. 
Otherwise with nost packages the scores are readily calculated using automated oorpute 
procedures. 

The chird step involves the calculation of regression equations predictirig the 
variate scores with all possible oorrbinations of the predictor variable sets of 
interest. In the present study interest centered on the prediction of the four 
criterion variables (represented by the variate scores labelled "Y*" in Table 1) using 
the predictors age, locus of control, religious preference, and the three job role 
contrasts as a set (labelled "D*") . The 15 oontbinations of these predictors, their 
predictive abilities, and the use of the values in computing canonical uniqueness and 
conrranality estiinates are presented in Table 2. Again, readers can verify these 
results by analyzing the relevant portioi of the Table 1 correlation matrix, this time 
involving variables labelled "Y*", and "A" through "P". 

INSERT TABLE 2 TfflOOT HEE^E. 
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It should be noted that ooefficients involving the "D*" variable set actually 
involved three predictors, "D" through "F". For exawple, the squared nuitiple 
correlation involving the car-onical variite scores ("Y*'') and the j:hree predictors in 
the job role set ("D*") -was .01820. Thus^ the exanple makes the point that these 
procedures can be eiitployed bo exaniinci either indivi.dual variables or various sets of 
variables. Of course, the squared multiple oorrelyAtion using all the predictors to 
predict "Y*" (.13739) exactly equals the squared canonical oorroLzttion since in the 
full model case the regression analysis is a canonical analysis. 

Table 3 summarizes the results in the manner reconinended for thu regression case 
by Mayesks et al. (1969) . As should be expected, since the 15 values are partitions of 
the squared canonical correlation, the 15 partitions^ sum to the value of the squared 
canonical correlation. Furthermore, as noted in the table, the analysis also 
partitions the individual predictive power of the predictor variables represented by 
the squared correlations with the canonical variate scores. 

INSECT TABLE 3 ABOOT HERE. 

Discussion 

Canonical cornnonality analysis is not without limits. For exaitple, as Newton and 
Spur r ell (1967, p. 61) note, '•it is difficult to see that statistical theory will be 
able bo give sampling errors which can be used in meaningful tests for secondary 
elements [ccsmonalities] since they are obviously not ind^)endent statistical 
quantities." However, tlie inability to statistically test comonalities does not seem 
inherently debilitating since the technique'^s focus is on interpretaticxi after a 
significant canonical correlation has already been detected. Furthermore, the focus is 
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cxjosistent with the recognition that statistical significance is priroaurily a function 
of sample size (Carver, 1978), and with an enphasis on effect sizes in meta-analysis 
dirtd other applications (Glass, McGaw & Smith, 1981). 

ConnDnallty analysis honors the relationships arong variables in a set, and as 
Seibold and McPhee (1979, p. 355) argue: 

Advancement of theory and the useful e^lication of research 
findings depend not only on establishing that a relationship 
exists among predictors and the criterion, but also upon 
determining the extent to which those independent variables, 
singly and in all possible combinations, share variance with 
the dependent variable. Only then can we fully know the 
relative inportance of independent variables with regard to the 
dependent variable in question. 
As Mood (1969, p. 480) notes, **aiie independent variables in any social process, and 
certainly in education, are highly correlated anong themselves, and this kind of 
partition of variance provides measures of the extent to which they overlap each other 
in their association with the dependent variable." 

A final benefit of canonical comonality analysis is didactic. The extension of a 
regression technique to the canonical case reinforces the recognition (Knapp, 1978) 
that canonical analysis is the m^st general case of parametric significance testing. 
Understanding the linNages among various statistical methods may facilitate more 
considered analytic dhoices in contemporary research practice. 
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Table 1 

Correlation and Canonical Function Coefficients 



Function 



Criterion Variables 




W 


X 


Y 


Z 


Y* 


A 


B 


C 


D 


E Ooefs. 


Coping with Death (W) 






















.567 


Fear of Dying (X) 




-00003 


















.635 


Shortness of Life (Y) 




-00001 


00000 
















-.491 


Painful Death (Z) 




00000 


00000 


00001 














.185 


Predictor Variables 
























Age (A) 




-15690 


-17885 


13266 


-09564 


-28534 










-.698 


Locus of Control (B) 




12944 


20089 


-09838 


03795 


25630 


-19567 








.610 


Religious Preference (C) 


08211 


03595 


-09457 


-18293 


08205 


-15454 


-08741 






.227 


Role Group Contrast 1 


(D) 


-09408 


06045 


04350 


-03547 


-04283 


-11957 


07962 


02673 




-.254 


Cciitrast 2 


(E) 


06376 


13514 


05524 


06344 


10657 


-35704 


12548 


04629 


00000 


-.049 


Contrast 3 


(P) 


13771 


-01418 


-04437 


-10881 


07074 


-26963 


07028 


39279 


00000 


00000 -.129 



Note ; "Y*" represents the set of canonical variate scores for the critericMi variable set. 
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Table 2 

Canonical Conmonality Ccn|xatations 



Uniqu'3 to A 
Unique to B 
Unique to C 
Unique to D* 
Oonmon to ; ,2* 
Ccnmon to A,C 
Coninon to A,D* 
Gannon to B,C 
Coinnon to B,D* 
Cdimon to C,D* 
Cormon to A,B,C 
Cannon to A,B,D* 
Comon to A,C,D* 
Coimon to B,C,D* 
Ccnmon to all 



A,B,C,D* 
.13739 
r2 

A,B,C,D* 
.13739 

A,B,C,D* 

.1^^739 

A,B,C,D* 
.13739 
r2 + 

A,C,D* 
.08959 



A,B,D* 
.yi57 
R^ 

A,B,C 
.12727 
r2 

A,B,D* 
.13157 

A,B,C 

A, B,C 
.^727 

C,D* 
.02122 + 
R^ + 

CD* 
.02122 
r2 

B, D* 
.07807 
r2 

A,D* 
.08751 
r2 

D* 

.01820 
r2 

C, D* 
.02122 



- R^ 

B,C,D* 

- .08600 ' 
-r2 

A,C,D* 

- .08959 ' 

- R"^ 

A,B,D* 

: ■ 

A,B,C 

- .12727 ' 
r2 

B,C,D* 
.0^600 - 

B,C,D* 

.Ojgeoo - 

B,C,D* 
.08600 - 
r2 

A,C,D* 
•08959 - 
r2 

A,C,D* 
.01959 

A,B,D* 
.13157 



.05139 



.04780 



.00582 



« .01012 
r2 " 
C,D* 
.0|l22 - 

B,D* 
.07807 - 
R ^ 

B,C 

.07668 - 
r2 - 
A,D* 
.08751 - 
r2 - 

A,C 

.08290 " 



- n 2 



+ R 



A,B 

12321 
+ 



r2 
A,B,C,D* 

.l|739 « .01698 
A,B,C,D* 

.13739 « .00211 
R^ 
A,B,C,D* 

.13739 —.00080 
r2 
A,B,C,D* 

.13739 «".00374 
r2 

A,B,C,D* 

.1^739 —.00343 
R-^ 

A,B,C,D* 



B,D* 
.07907 
R 

B,D* 
.07807 
r2 

B,C 
.07668 
R 2 

A, C 
.0|290 

C 

.00673 + 
r2 - 

B, D* 
.07807 - 



r2 

A,D* 
.08751 
R ^ 

A,C 
.0|290 

A, B 
.12321 
r2 

A|B 

.12321 + .13739 
R 2 + r2 

B A 
.06569 + .08142 
R2 - r2 

B, C A,D* 
.07668 - .08751 



-^13739 
r2 

A,B,C,D* 
.13739 
R^ 
A,B,C,D* 
.13739 
r2 

A,B,C,D* 
.13739 
r2 
A,B,C,D* 



[10941 



D* 

(IJ820 



- R 
C 

- .00673 
-r2 

B 

- .06569 
-r2 

A 

- .08142 
+ r2 + 

B,C,D* 
+ .06600 + 

- r2 

A,C 

- .08290 - 
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-r2 

B,C,D* 

- .Q8600 

- R"^ 

B,C,D* 

- .08600 

- r2 

B,C,D* 

- .08600 
-r2 

A,C,D* 

- .08959 
r2 + 

A|C,D* 
.08959 + 
R2 

A,B 

.12321 - 

16 



-r2 

A,C,D* 

- ^8959 

A,C,D* 

- ^959 

A,B,D* 

- .13157 
-r2 

A,B,D* 

- .13157 
r2 , + 

A,B,D* 
.13157 + 
r2 

A|B,C,D* 
.13739 1 



-.00117 



-r2 
A|B,D* 

.VP"' - 

A,B,C 

- .12727 » .00999 

- r2 

A,B,C 

- .12727 —.00635 
-r2 

A,B,C 

- .12727 —.01001 
R^ 

A,B,C 
.12727 



.01066 



• • • 
♦ • • • 
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Table 3 

Sumnary of Conronality Results 







A 


B 


C 


D* 


Unique 


to Age (A) 


5.1% 








Unique 


to Locus of Control (B) 




4.8% 






Unicrue 


to Religious Preference (C) 




.6% 




Unicfue 


to Role Contrasts (D*) 








1.0% 


Conmon 


to A,B 


1.7% 


1.7% 






Conmon 


to A,C 


.2% 




.2% 




Conmon 


to A,D* 


-.1% 






-.1% 


Common 


to B,C 










Conmnn 


to B,D* 




- 3% 




- 3% 




to C,D* 










Camon 


to A,B,C 


-.1% 


-.1% 


-.1% 




Connon 


to A,B,D* 


1.0% 


1.0% 




1.0% 


Canton 


to A,C,D* 


-.6% 




-.6% 


-.6% 


Conmon 


to B,C,D* 




-1.0% 


-1.0% 


-1.0% 


Camon 


to A,B,C,D* 


1.1% 


1.1% 


1.1% 


1.1% 


Sum of 


Partitions in Coluim 


8.3% 


6.7% 


.7% 


2.0% 


Squared Correlation with 










Canonical Variate Scores 


.0814 


.0657 


.0067 


.0182 



Note ; The sum of the 15 partitions (.13878) equals the squared cancxiical correlation 
cx>efficient within rounding error. 



17 



